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Section  I 


Introduction 


Overview 


Three  of  the  major  assumptions  that  are  embedded  in  the  current 
reorder  level  computations  utilized  in  the  Economic  Oriicr  Qu.intity 
(EOQ)  Buy  Computation  System  (D062)  are  the  fol lowing: 


1.  Demand  in  a  lead  time  is  normally  distributed. 


2.  The  leadtime  is  known  and  constant. 


3.  The  mean  and  standard  deviation  of  loadtiine  (lc:n;iiu!  may 
be  accurately  estimated  from  available  history. 

These  assumptions  are  used  in  a  number  of  commercial  inventory 
management  systems,  and  simulation  studies  using  actual  demand 
history  for  Air  Force  items  have  shown  that  the  resulting  formulas 
are  significantly  more  cost  effective  than  the  inventory  level 
computations  which  were  previously  in  use.  However,  several 
recent  studies  have  shown  that  the  above  assumptions  may  not 


« 

I 


be  an  accurate  approximation  to  tlie  clia  rac  to  r  ist  ics  of  a  number 
of  D062  items.  For  example,  Hayya  (1980)  observed  that  leadtimes 
for  a  sample  of  62  high  activity  D062  items  had  significant  vari¬ 
ability.  Also,  in  Reference  3  it  was  found  that  the  distribution 
of  errors  in  forecasting  demand  in  a  given  leadtiine  is  better 
described  by  a  combination  of  exponential  functions  than  by  a 
normal  distribution. 

If  assumptions  one  thru  three  above  are  replaced  by  other 
models  of  D062  demand  and  leadtime  p*rocesses,  alternate  formulas 
for  computing  optimum  reorder  levels  are  obtained.  Tb.  i  s  iipoi 
presents  the  results  of  simulation  experiments  to  evaluat'.;  the 
relative  cost  effectiveness  of  several  of  these  alternate  "optimum" 
computations  compared  to  current  D062  formulas. 

The  paper  is  organized  as  .ullows:  Section  I  presents  addi¬ 
tional  background  for  this  study.  This  section  descriiies  tlie 
general  formulas  to  be  evaluated,  the  item  samples  used  to  simu¬ 
late  the  n062  system,  and  the  features  of  t)ie  simulation  experiment 
In  Section  II,  we  present  general  observations  concerning  tlie 
demand  patterns  and  inventory  system  behavior  for  each  of  these 
item  samples.  In  Section  III,  we  present  measurements  of  the 
sensitivity  of  the  INSSIM  model  to  several  key  parameters.  Simula¬ 
tion  results  for  Policy  Code  20,  to  be  defined  later,  are  also 
discussed  in  this  section.  In  Section  IV  we  present  cost  effective 
ness  curves  which  quantify  the  relative  strengths  and  weaknesses 
of  each  of  the  proposed  formulas.  Finally,  in  Section  V  we  present 
the  general  conclusions  obtained  from  this  study. 


Inventory  Management  PolirAes  i'or  Hyaluation 


Six  basic  inventory  management  policies  were  selected  for 
detailed  evaluation  in  this  study.  A  brief  discription  of  these 
policies  and  the  associated  "Inventory  Management  Policy  Code" 
which  was  used  to  identify  these  runs  in  subsenuent  simulation 
experiments  are  presented  in  Table  I-l.  Let  us  now  consider 
each  of  these  formulas  in  more  detail. 


Policy  C od e_  1^0 Th e  C u r r^e n t  1)06  2  Formiil'is 


As  shown  the  table.  Policy  Code  10  denotes  the  current  ])()02  inv'en- 
tory  management  formulas.  These  computations  arc  based  on  formulas 
originally  developed  by  Presutti  and  Trepp  (1970).  These  authors 
consider  the  problem  of  determining  order  quantities  and  reorder 
points  for  each  item  in  a  single-echelon,  multi-item,  continuous 
review  invc'iitory  systoiii  so  as  to  miniuiize  total  system  holding 
and  shortage  costs  subject  to  a  constraint  on  the  average  number 
of  units  in  a  backorder  position.  Presutti  anci  Trepp  luyi'in  l>v 
assuming  that  demand  in  a  leadtime  is  normally  distributed. 

However,  they  then  utilize  the  Laplace  distribution  to  approximate 
the  normal.  With  this  substitution,  Presutti  and  Trepp  obtain 
closed  form  expressions  for  the  optimum  order  quantity  and  reorder 
point.  For  convenience,  we  refer  to  these  resulting  formulas 
as  the  PT-formulas.  Subsequent  simulation  studies  using  actual 
demand  history  for  Air  Force  items  showed  that  the  PT-formulas 
were  significantly  more  cost  effective  than  the  inventory  level 


"T  f  ■  I'l  I  '^w  i'llii 


Table  I-l 

Inventory  Management  Policy  Codes 


Inventory  Management  Policy 
Current  D062  Formulas 

Current  D062  Formulas,  with  outliers  excluded  from  demand  and  vari¬ 
ance  estimates 

Current  D062  Formulas,  with  adjustments  to  standard  deviation  of 
lead  time  demand  to  account  for  lead  time  variability 

Scaled  Negative  Binomial  reorder  point  calculations,  with  no  bounds 
on  safety  level 

Constant  Leadtime  Exponential  Forecast  Error  model,  with  no  bounds 
on  safety  level 


Exponential-Gamma  Forecast  Error  Model,  with  no  bounds  on  safety 
level 


compulations  tlien  in  use;  tliat  is,  rlic  I’T- formul  as  jjrov'iiko  lower 
levels  of  backorders  for  a  given  investment  in  i  iventory  tlian 
the  previous  formulas,  or,  conversely,  a  given  backorder  level 
could  be  achieved  with  the  PT-formulas  for  a  smaller  investment 
in  safety  stocks. 

The  basic  calculations  used  to  implement  the  PT-formulas 
in  the  D062  system  are  shown  in  Figures  I-l  thru  1-5.  Figure 
I-l  presents  formulas  for  obtaining  the  demand  rate,  average 
requisition  size,  and  standard  deviation  estimates  required  in 
the  PT-formulas.  These  estimates  arc  based  on  moving  averages 
involving  at  most  8-quarters  of  historical  demands.  As  shown 
at  the  bottom  of  the  figure,  these  historical  averages  may  then 
be  modified  to  account  for  forecast  changes  in  flying  program 
activity. 

As  shown  in  Figure  I-l,  the  standard  deviation  of  ileni.uuis 
in  the  leadtime  o'  is  a  major  p.iramercr  in  the  cunciu  hiu  v.ai\;iy 
level  calculations.  However,  demand  in  a  leadtime  is  not  presently 
recorded  in  the  D062  system.  Conseouently,  the  parameter  o- must 
be  estimated  from  available  data.  I.ot  QMM)  flonotc  the  Mean  Absolute 
Deviation  associated  with  the  demands  observed  in  each  of  the 
last  eight  quarters,  and  let  t  denote  the  expected  replenishment 
leadtime  for  an  individual  item  (i.e.  t  represents  the  sum  of 
administrative  and  procurement  leadtimes).  Then  in  D062  the 
parameter  O'  is  estimated  from  the  following  formula; 


riqurc  T-l  'I'or \".t  an'l  .''>{-ar  ^  j  i  ‘  i ,%.) 

Calculation  I'o:';  .ul.'.n  c  .  .  :  i.i 
Subrou  t  i no  TO '•  j 7  > > . 


Ouartorl'^  U'^mnd  'late: 

roues'^  =  >  (Crons  Donanfl  )  -  (norviconV  T  roti'.rn-.  ) 

n  =  1 - H - 

where  ■?  or’uals  the  nr.r.'icr  o^  fiu.irt<'rr.  o'"  av.i'  la''!''  ...ii,.:. 
Annual  bena^Kl  Tlato; 

AnTl(M)  =  *  FOT’CST 

Averano  Tlo<nv>.nition  Ci:;o ; 

’J 

CRf)r:r; 

ur,osi7,  (?j)  =  n  ^  1 _ 

n:  •  re 

n 

Quarterly  C-AO; 

yvctual  Onax'ter ,1''  -  3  *  'i’V* 

n 

where  ’1  nunber  of  qxiar'cern  of  nati 
ntandard  boviation  o'*  brao  'T^i’^io  OofMi-l 

CIC  -  n.r.O-lf.*  rv.no*  (0.82375  ^  0.42625*  Loadliir.c  Monv-iaO 


Program  Factor  Ad.lustments 

Let  I'F  Program  Factor  Patio  of  the  forecast  flying  program  in  the  next 

two  years  to  the  actual  program  in  the  last  two 
.years. 

'Then  if  PF  in  not  equal  to  1.00, 

Replace  Arw(N)  by  ADR(N)*PF 

0.8s 


and  Replace  SIC  by  SIG*PF 


(1)  <T  =  0.5945  *  OMAl)  *  (  O.S23j  + 


0.42625  *  I  ) 


This  estimation  formula  is  based  on  a  calculation  su^jgested  by 
Robert  G.  Brown  (19C7\  The  calculation  assunic-.  tiiat  the  lead- 
time  t  is  known  with  certainty,  and  it  adjusts  f;,:  the  fact  that 
forecasts  of  demand  rates  are  based  upon  iiioviny  av  e  ra  >;  e  estimates. 

Figure  1-2  illustrates  the  formulas  used  to  compute  the  bconomic 
Order  Quantity  (EOQ).  This  quantity  represents  the  numner  of 
units  to  be  ordered  when  available  stocks  re.ic!i  the  rcorde.  level. 

As  shown  in  the  figure,  two  basic  procurement  iicetitods  are  utilized 
to  purchase  the  items  managed  by  the  D062  svstem.  One  meti'.od 
applies  to  purchases  which  are  less  than  a  critical  iv.e.iknui  n  t , 
denoted  by  the  symbol  "CSTBRK"  in  the  figure,  while  the  second 
procurement  method  refers  to  purchases  of  large  dollar  magnitude. 
Less  procurement  effort,  and  consequently  lower  orcierins;  costs, 
are  associated  with  small  purchases.  As  shown  in  liguie  i-2, 
a  small  purchase  order  quantity  is  first  computed.  If  tltis  order 
quantity  is  less  than  the  dollar  breakpoint  CSTP.llK,  that  order 
quantity  is  adopted.  Otherwise,  the  large  nurch.ise  cost  to  order 
parameter  is  used  to  compute  the  EDO  quantity. 

After  the  tentative  EOQ  is  computed,  tliis  quantity  is  bounded 
to  lie  between  two  bounds  specified  by  management.  First,  a 
lower  bound  is  placed  on  tlie  EOQ  quantity  to  prevent  extremely 
high  frequencies  of  reorders  for  high  dollar  activity  items. 


ligure 

L.oiiomic  OrUci'  Quantity  Calculations 


C  hen 


Q  =  Older  quant i ty 

RMR  =  'lonthly  demand  rate  (units) 

ADR  =  \iinu.i  1  demand  rate  (units) 

CUSuKI'vIj  =  c.ost  to  place  an  order,  where 

1  =  1  indicates  small  purchase  and 
1  =  I  indicates  large  purchase  iiiethou> 
CSl'DKK  ^  UolJai  breakpoint  distinguishing  large  and 
small  purciiase  methods 

COSliLD  =  Cost  to  hold  one  dollar  of  stock  ii.  inveiitory 
for  one  year 
UC  =  I t em  un it  cost 


/2*  COSUKI)  m  *  ADR 
■■J  COSliLD  *  DC 


Provided  Q.C  ^  CS'l  lji<K 


Ot  herw I se , 


^  COSOHDTD’  *  ADR' 
Q  -  /  CUbriLi)'*  DO 
N 


1;()()  Size  Limits 


Por  the  order  quantity  Q  computed  above, 

if  Q  >  l.UQMAX  *RMK,  set  Q  =  tOQMAX  *  RMR 
if  QvLOQMIN  *RMR,  set  Q  =  F.OQMIN  *  RMR 
if  Qsl,  set  Q  -  1 


i  - 


On  the  other  hand,  an  upper  bound  is  also  placed  on  the  l:U(j  to 
prevent  unrealistically  large  order  quan t i t i es- - represen t i ng 
many  years  of  supply--to  be  brought  into  the  Air  Force  supply 
system.  This  upper  bound  is  to  protect  against  unacceptably 
high  obsolescence  rates  which  might  occur  if  progiam  levels  unex- 
pectly  decline. 

Figure  1-3  illustrates  the  formulas  used  to  compute  safety 
levels  in  the  D062  system.  As  shown  in  the  figure,  an  important 
element  in  this  computation  is  a  priority  factor  Z.  At  present, 
this  priority  factor  is  set  equal  to  the  square  root  the  average 
requisition  size  for  an  individual  item.  As  sliown  in  the  ligiire, 
a  tentative  safety  level  is  computed  in  step  (cj.  I'h  i  s  tentative 
safety  level  is  then  bounded  to  be  no  less  than  zero,  and  no 
more  than  the  upper  bounds  specified,  in  step  (d).  Specifically, 
the  safety  level  is  limited  to  be  no  more  than  the  lesser  of 
either  (a)  the  expected  demands  in  the  forecast  leadtimo,  or 
(b)  three  times  the  standard  deviation  of  leadtime  demands. 

Policy  Code  20 

In  studying  the  detailed  demand  histories  of  individual  1)002 
items,  we  observed  that  many  items  contained  large  "spikes”, 
i.e.  quarters  of  very  large  demand  which  did  appeared  incons ist^^nt 
with  demands  both  before  and  after  the  occurrence  of  the  spike. 
When  such  spikes  occur,  both  reorder  levels  and  reorder  quantities 
computed  by  the  PT-formulas  jump  significantly,  and  may  trigger 
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Sufety  Level  (.a  1  cui  a  t  i  ons 
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Li¬ 


st  =  Safety  level 

Q  =  Order  quant  it\'  ( l  iie  LOQJ 

KMk  =  Monthly  uemand  rate  (units) 

Kl.'l  =  LxpeCtoil  number  of  demands  in  a 
Z  =  A  priority  factor  as  del’ineil  in 

<J  ~  Sl.iiulaid  devi.ition  ol  dem.inJ  in 


i-ail  time 
.  1  i )  I  e  1  •  .') 


ne  1  e 


:-ad  time 


t  hen 


(a)  I'or  a  given  pi-licy,  set  Z  as  defin  o  in  'Janie  1 

(b)  Compute  K , 


K  =  0,7U7  X  LN 


I  Imp  lied  \ 
I  Short  age 
\l-actor  j 


/  lio  1  d  i  ngi 

jOnitl 

(cost  1 

\cos  t 

I  (T.  (  1  '  1:\  i’  I  '"■  )  ) 


( )  Tentative  ■.alely  level  =  SL  =  K 
If  SL  •^0,  reset  SI.  =  -0 

(d)  If  upper  bounds  are  to  be  applied, 
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If 

SI. 

KLT, 

reset 

SL  -  Kl.T 
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If 

SL 

3*<r. 
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S  L  =  3  '■  rr 
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new  buys  of  material.  If  iieinan<!'>  return  to  their  previous  levels 
in  subsequent  quarters,  this  material  often  becomes  surplus. 
Consequently,  we  hypothesized  that  inventory  management  effective¬ 
ness  might  be  improved  by  using  forecasting  methods  which  test 
for  the  presence  of  spikes  and  which  eliminate  unreasonably  large 
demand  observations  from  the  forecasting  calculations.  Formula 
Code  20  uses  such  a  test  for  outliers.  Under  this  Policy  Code, 
we  first  determine  the  largest  demand  observed  in  tiie  last  eigliL 
quarters.  We  then  compute  the  average  demand  rate  and  tbe  MAD 
of  the  seven  remaining  data  points.  If  the  largest  observation 
is  within  four  times  the  MAD  of  the  average  rate,  that  large 
observation  is  included  in  the  forecast  calculations,  i)tiierwise, 
the  large  observation  is  declared  an  "outlier”,  and  it  is  ijiiored 
in  the  demand  and  MAD  estimates.  Once  the  demand  rate  and  'dAD 
estimates  are  obtained,  the  standard  1)062  HOQ  and  safet>  level 
calculations  are  performed.  Thus,  Policy  Coile  20  differs  f i  om 
Policy  Code  10  in  its  estimates  for  the  mean  and  MAI)  (O'  demands, 
but  is  otherwise  identical  to  the  current  D062  formulas. 


Policy  Code  60 


As  shown  in  Table  1-1,  Policy  Code  60  utilizes  the  current 
D062  forecasting,  safety  level,  and  EOQ  formulas,  but  adjusts 
the  estimate  of  the  standard  deviation  of  leadtime  demand  to 
account  for  leadtime  variability.  As  noted  above,  the  current 
D062  estimate  for  the  standard  'deviation  of  leadtime  demand  «r 


assumes  that  leadtime  is  known  with  certainty.  However,  if  lead- 
times  are  variable,  the  above  estimates  are  no  longer  valid. 

One  approach  for  estimating  the  standard  deviation  of  leadtime 
demand  with  leadtime  variability  considered  is  as  follows;  First, 
let  denote  the  demand  in  period  i,  and  let  L  denote  the  number 
of  periods  in  the  leadlime.  Tiien  the  total  leadtime  demand  is 
g  i  veil  by  ; 

(2)  T  .  X,  .  Xj  .  .  .  .  «  X, 

Let  u  and  O’  denote  the  expected  value  and  standard  deviation 
of  X-,  and  let  and  cTj  denote  the  expected  value  and  standard 
deviation  of  leadtime.  If  we  assume,  that  the  X' ■  are  i  i^depcndon  t 
random  variables,  and  that  the  actual  leadtiine  L  is  independent 
of  demand,  then  the  standard  deviation  (T,|,  of  demand  in  the  lead- 
time  is  given  by 

otj.  =  ^U|  +  u^^iT|^ 

In  our  simulation  experiments,  we  used  this  formula  to  estimate 
the  standard  deviation  oi^  demand  in  a  leadtime.  The  D062  formulas 
illustrated  in  Figures  I-l  and  1-2  were  then  used  to  compute 
order  quantities  and  safety  levels  for  individual  BOO  items. 


In  the  simulation  experiments  to  he  discussed  In  Section 
IV,  we  assummed  the  lead  times  of  all  items  were  j^amma  distributed 
with  a  coefficient  of  variation  of  5S‘i.  We  used  this  fact  directly 
in  (3)  to  estimate  the  standard  deviation  of  Jeadtime  cTj  .  In 
practice,  this  parameter  would  have  to  he  estimated  from  availabie 
data,  and  would  be  subject  to  substantial  estimation  errors. 

Thus,  this  Policy  Code  60  rule  should  perform  better  in  (jiir  simula¬ 
tion  studies  than  it  would  perform  if  implemented  into  the  1)062 
system. 


Policy  Code  70 


Formula  Code  70  uses  the  scaled  negative  binomial  probninlity 
distribution  as  a  model  for  demands  in  a  leadtime.  This  mode] 
is  based  upon  work  by  Nahmias  and  Demmy  (1981).  These  authors 
consider  a  situation  in  which  requisition  sizes  are  described 
by  the  logarithmic  distribution  and  in  which  customers  arrive 
according  to  a  Poisson  process.  Further,  they  assume  that  lead- 
times  are  gamma  distributed.  These  assumptions  appear  to  be 
reasonable  approximations  to  available  D062  demand  and  leadtime 
data.  With  these  assumptions  they  derive  the  probability  distribu¬ 
tion  for  demands  in  the  leadtime.  They  call  this  model  the 
Logarithmic-Poisson-Gamma  (LPG)  distribution.  Unforturnate ly , 
evaluation  of  data  points  for  the  LPG  distribution  require  substan¬ 
tial  computational  effort.  However,  in  Reference  4  Demmy  and 
Nahmias  found  that  the  scaled  negative  binomial  distribution 
provides  a  good  approximation  to  the  LPG  for  a  wide  range  of 


I 


parameter  values.  Consequently,  the  scaled  negative  bionoiiiial 
model  was  selected  for  testing  in  these  experiments. 
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Policy  Code  80 

Reference  3  presents  the  results  of  a  statistical  analysis 
of  the  distribution  of  forecast  errors  associated  with  current 
D062  demand  forecasting  procedures.  In  this  reference,  it  is 
observed  that  a  combination  of  exponential  functions  provides 
a  better  approximation  to  the  distribution  of  forecast  errors 
than  the  normal  probability  model.  In  Policy  Code  80,  we  assume 
that  the  Icadtime  is  known  with  certainty,  and  Liie  exponent  lai 
forecast  error  model  is  used  to  compute  percentav.e  |)o  i  n  l  s 
the  distribution  of  demand  in  a  Icadtime.  Details  of  the  'XjMinen- 
tial  forecast  error  model,  and  a  coinparision  of  this  model  with 
the  distribution  currently  oinployc<l  in  0062  may  l>e  found  in 
Reference  5. 


Policy  Code  90 

This  inventory  managcmeiu  policy  utilizes  tlie  exponential 
forecast  error  model  discussed  for  Policy  Code  80,  but  assumes 
that  leadtimes  are  gamma  distributed.  In  this  model,  the  distribu¬ 
tion  of  forecast  errors  in  a  given  leadtime  t  is  weighted  by 
the  probability  of  occurence  of  the  specific  leadtime  value  t. 


This  results  in  a  leadtiine  demand  distribution  with  a  higher 
variance  tiian  that  given  by  Folic/  Code  80.  A  detailed  discussion 
of  the  formulas  for  Policy  Codes  80  and  90  may  be  found  in  Reference 
5,  In  addition.  Reference  5  presents  a  number  of  plots  which 
describe  the  sensitivity  of  these  formulas  to  changes  in  several 
important  parameters. 

Support  Leye^Codes  and  Run  Codes 

An  important  input  to  all  of  the  inventory  management  policies 
that  were  tested  is  the  implied  cost  of  a  sliortage,  which  we 
shall  denote  by  the  symbol  C.  If  C  is  large,  safety  stocks  should 
be  high  to  keep  shortage  costs  to  a  reasonable  level.  On  t nc 
other  hand,  if  C  is  small,  the  penalty  for  shortages  is  not  as 
great,  and  less  safety  stocks  should  be  procured. 

Table  1-2  presents  the  sliortage  cost  factors  used  in  this 
study,  as  well  as  an  associated  "Support  Code."  The  Support 
Code  was  used  to  identify  given  simulation  runs  in  post -jirocoss  i  ng 
ca 1 cul at i ons .  Specifically,  each  simulation  run  was  assigned 
a  "Run  Code"  of  the  form  XXYY ,  where  XX  denotes  a  specific  inven¬ 
tory  policy  code  from  Table  I-l  and  YY  denotes  a  specific  Support 
Code  from  Table  1-2.  Thus,  the  run  code  7030  represents  a  scaled 
negative  binomical  calculation  (Policy  70)  using  an  implied  shortage 
cost  of  500  (Support  Code  30).  Similarly,  run  code  1030  repre¬ 
sents  the  current  D062  formulas  (Policy  10)  using  an  implied 


Table  1-2 


Support  Level  Codes 


Support  Shortage  Cost 

Code  Factor 


J-iV 


shortage  cost  of  500. 


Inventory  Management  Parameters 

Each  of  the  inventory  management  policies  requires  several 
inputs  in  addition  to  the  implieil  cost  of  a  shortage.  Table 
1-3  presents  the  parameter  values  that  were  used  in  all  Policy 
10  runs.  With  the  exception  of  bounds  on  the  safety  level,  tiiese 
same  parameter  values  were  used  for  all  of  the  other  Po]ic\  Code 
simulation  runs.  However,  as  noted  above,  the  safety  level  bound¬ 
ing  rules  varied  among  the  policies. 


Table  1-3 
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Inventory  Management  Parameters 


Cost  to  Hold  Inventory  20%  of  unit  cost  per  year 

Order  Cost  for  Small  Purchases  $300/order 

Order  Cost  for  Large  Purchases  $  500/order 

Small  Purchase/Large  Purchase  Breakpoint  $  19,500/order 


Minimum  EOQ 
Maximum  EOQ 


6  months  supply 
36  months  supply 


Minimum  Safety  Level  0 

Maximum  Safety  Level  Minimum  of  expected  lead  time 

demands,  or  three  times  the  stand¬ 
ard  deviation  of  demand  in  a  lead 
time. 


Support  Level 


1  month  supply 


Evaluation  Approach 

We  used  the  Inventory  System  Simulator  (INSSIM)  to  evaluate  the  relative  cost 
effectiveness  of  each  of  the  proposed  fortriulas  discussed  above.  The  Inventory  System 
Simulator  provides  a  detailed  description  of  the  Economic  Order  Quaniiity  Buy 
Computation  System  (D062),  and  utilises  actual  0062  demand  histories  to  drive  the 
simulation  process.  For  this  study,  we  modilied  tlie  original  version  of  INSSIM  to 
provide  the  capability  to  simulate  random  leadtimes  and  to  provide  a  more  detailed 
description  of  the  requisition  generation  process.  A  detailed  description  of  the  original 
INSSIM  model  may  be  found  in  References  6  and  7,  while  Reference  2  describes  the  new 
routines  which  were  developed  for  this  study.  Let  us  now  consider  the  detailed  rules 
which  are  incorporated  in  the  simulation  scenario  selected  for  this  study. 

The  Simulation  Scenario 

As  noted  above,  the  Inventory  System  Simulator  provides  a  detailed  d(  a nption  of 
the  D062  inventory  management  system.  Major  rules  which  wore  in; orpor.ucc!  in 
INSSIM  for  this  study  are  the  following: 


1.  The  total  number  of  units  demandcil  in  each  simul.ited  quarter  exactly  f'qu.ils 
the  D062  historical  values  for  each  simuleced  item.  However,  Monte  Carlo  techniques 
are  used  to  generate  the  specific  sizes  of  individual  requisitions.  Both  high  and  low 
priority  requisitions  are  simulated,  and  there  is  a  50%  chance  that  any  givoii  requisition 
is  a  high  priority  demand.  Individual  requisitions  within  a  given  quarter  are  obtained 
from  a  negative  binomial  distribution.  Because  pf  the  lack  of  accurate  requisition  data 
during  the  earlier  quarters  of  the  INSSIM  Data  Bank,  requisition  size  parameters  are 
derived  from  the  12  most  recent  quarters  of  demand  history. 


2.  Forecast  ol  itetn  deinand  rates  and  associated  salety  levels,  reoi  der  points, 
and  order  quantities  are  updated  each  quarter.  Forecasts  are  based  on  an  eight  quarter 
moving  average,  with  proportional  adjustments  for  forecast  changes  in  flying  program 
activity.  With  the  exception  of  Policy  20,  all  inventory  management  rules  evaluated 
use  the  current  D062  forecasting  formulas.  Policy  20  deletes  outliers  from  the  demand 
rate  calculation,  but  is  otherwise  identical  to  the  D062  calculation. 

3.  Safety  stocks  and  EOQ  quantities  are  based  upon  specific  inventors  .nanage- 
ment  formulas  which  are  specified  as  input  to  the  simulation.  The  basic  for  njlas  used 
are  identified  above.  Safety  stocks  are  then  computed  and  Ijounded  .n  i  orumg  to 
management  parameters  specified  as  input  to  th»  simulation.  As  noted  above,  Table  I-l 
presents  the  current  D062  inventory  policies  considered  in  this  study,  while  Figures  I-l 
thru  1-3  define  the  specific  forecasting,  EOQ,  and  safety  level  formulas.  EOQ 
quantities  are  bounded  to  lie  between  6  and  36  limes  the  forecast  monthly  demand  rales 
for  all  inventory  management  policies. 

4.  Order  processing  costs,  inventory  holding  costs,  and  item  purctiase  ^.osts  are 
assumed  known  and  constant  throughout  the  simulation. 

5.  Leadtimes  are  assumed  to  be  gamma  distributed  with  a  mean  equal  to  the 
INSSIM  Data  Bank  leadtime  value.  The  coefficient  of  variation  of  leadtimes  is  assumed 
to  be  .353  for  all  items  simulated. 

6.  Initial  on  hand  stocks  are  set  equal  to  the  expected  demand  in  the  loadtime  in 
every  item  simulated,  and  initial  on  order  stocks  are  set  equal  to  zero.  This  assumption 
assures  that  no  item  is  in  an  "excess"  position  in  the  beginning  of  the  simulation  run. 
Flowever,  it  also  means  that  any  item  with  a  positive  safety  level  will  generate  a  "buy" 
during  the  first  week  of  simulation. 


Simulation  Hynamics 


A  total  of  38  quarters  of  data  were  available  Iron,  tlie  n0b2  history  records.  This 
data  covered  the  period  beginning  with  the  first  quarter  ol  CY7  1  and  continued  through 
CY79.  Eight  quarters  ol  this  data  were  used  to  initialize  tlie  historical  arrays  and 
demand  rate  estimates,  and  30  quarters  were  used  to  simuiau-  the  dynamii'  behavior  of 
the  system.  Consequently  the  simulation  evaluates  how  ea.-;;  of  tiie  proposed  rules 
would  have  performed  had  they  been  employed  beginning  w.tii  the  first  quarter  of 
CY73. 

Item  Samples 


As  noted  above,  the  Inventory  Sysu-m  Simulator  is  driven  by  actual  ce  uand 

histories.  For  this  study,  four  samples  of  up  to  '>00  items  each  .lerc  selected  the 

historical  records  in  the  INSSIM  Data  Bank.  The  criteria  used  to  select  t'nese  .te  ns  are 
presented  in  Table  1-4.  As  shown  in  Table  1-4,  two  samples  were  seiect.c  iroiri 
Sacramento  Air  Logistics  Center  (ALC),  while  two  samples  were  selected  from  D062 
history  records  from  Oklahoma  City  ALC.  A  "high"  and  "low"  activity  demand  sarriple 
was  selected  from  each  ALC.  Items  in  the  high  activity  sample  were  required  to  have 
demands  of  $5000  per  year  or  mon-  during  the  CY/1-72  period,  while  items  in  the  low 
demand  category  were  required  to  have  demand  activity  ol  less  than  $5000  per  year 
during  the  CY71-72  interval. 

In  previous  studies,  we  found  that  the  forecast  error  <  har.ii  li-nstics  associated 
with  F-104  and  F-5  aircraft  differ  significantly  from  the  error  characteristics  associ¬ 
ated  with  the  other  aircraft  represented  in  the  INSSIM  Data  Bank  records.  Conse¬ 
quently,  all  items  which  were  associated  with  F-104  and  F-5  aircraft  were  excluded 


Table  1-4 


Characteristics  of  Item  Samples 


Sample 

Code 

Air  LoRJStics  Center 

Number 

of 

Items 

CY71-72  Demands 

SM.H 

Sacramento 

450 

greater  than  $5000/yr 

SM.L 

Sacramento 

500 

less  than  $5000/yr 

OC.H 

Oklahoma  City 

500 

greater  than  $5000/yr 

OC.L 

Oklahoma  City 

500 

less  than  $5000/yr 

Note;  Items  associated  with  F104  and  F5  aircraft  were  excluded  from  all  samples. 


from  the  samples.  We  originally  planned  to  liave  500  items  included  wiihin  each 
sample.  However,  once  the  F-i04  and  F-5  items  were  deleted  from  the  bacramento 
high  activity  sample,  less  than  500  items  remained.  Consequently,  we  elected  to 
include  only  450  items  in  this  particular  sample,  but  a  total  of  500  items  in  all  three 
remaining  samples. 

Table  1-5  presents  statistics  on  the  aggregate  30  quarter  demand  activity  associ¬ 
ated  with  each  of  the  item  samples.  As  shown  in  the'table,  the  high  activity  samples 
have  significantly  greater  demands  that  the  two  low  demand  activity  demanc  samples. 
For  the  Oklahoma  City  high  activity  sample,  a  total  ol  343173  requisitions  rep; ov-mi ting 
approximately  825,000  units  of  demand  were  simulated.  This  demand  had  a  total  collar 
value  of  $55,153,000.  On  the  other  hand,  the  SM.H  sample  had  over  16  1,000  reci'i.sitions 
representing  over  $36,570,000  of  demand  during  this  period.  Finally,  the  low  activity 
samples  OC.L  and  SM.L  had  much  lower  levels  of  activity. 

The  vast  majority  of  current  (1981)  D062  items  would  fall  into  a  low  demand 
category  similar  to  that  represented  by  the  samples  OC.L  and  SM.L.  However,  the 
majority  of  current  D062  procurement  expenditures  are  associated  with  high  activity 
items  similar  to  those  included  in  the  samples  in  OC.H  and  SM.H.  Ity  u'.mg,  four 
samples,  we  hope  to  obtain  information  on  any  differences  in  performance  of  the 
alternate  formulas  among  these  important  categories  of  items. 


Table  l-i* 


Demand  Activity  in  30  Quarters 


Sample 

No.  of 
Items 

No.  of 

Requisitions 

No.  of  Units 
(1,000s) 

Total  Dollar  Value 
($  1,000s) 

OC.H 

500 

343,173 

825 

55,153 

SM.H 

450 

161,768 

301 

36,570 

OC.L 

500 

77,335 

138 

2,257 

SM.L 

500 

32,461 

44 

1,311 

Simulation  Results 


Each  item  sample  was  used  in  at  least  five  separate  simulation  runs  lor  eui.h  ol  the 
inventory  management  policies  tested.  A  large  number  of  tables  and  graphs  were  then 
developed  to  summarize  our  results.  In  the  next  section,  we  discuss  general  observa¬ 
tions  that  apply  to  all  the  inventory  policies  and  item  samples  used  in  this  study.  Plots 
of  the  behavior  of  demands  and  of  on  order  and  excess  stocks  under  current  D062 
inventory  management  rules  are  also  presented. 
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Sec  t ion  11 


General  Observations 

In  this  section,  we  discuss  the  general  patterns  of  inventory 
behavior  applicable  to  all  of  the  inventory  policies  considered 
in  this  study.  In  Sections  III  and  IV,  on  the  other  hand,  we 
present  comparisons  among  the  different  inventory  management 
policies. 

Item  Sample  Characteristics 

As  discussed  in  Section  I,  four  item  samples  were  selected 
for  this  study.  High  and  low  activity  samples  of  up  to  fire 
hundred  items  each  were  selected  from  the  Oklahoma  City  and  Sacra¬ 
mento  Air  Logistics  Centers  (ALC).  We  represent  these  four  item 
samples  by  the  symbols  OC.H,  SM.H,  OC.L,  and  SM.L,  respectively. 
All  four  item  samples  were  selected  from  the  INSSIM  Data  Dank. 
Consequently,  to  be  included  in  this  stuty  an  item  must  have 
had  at  least  one  demand  in  the  CY7i-72  interval,  and  the  item 
must  have  been  listed  in  the  U062  inventory  system  records  at 
the  same  Air  Logistics  Center  throughout  tlie  CY7i-7y  interval. 
Consequently,  no  new  items  were  included  in  tlie  samples  used 
in  this  study. 

Items  included  in  the  INSSIM  Data  Bank  provide  support  for 
24  different  USAF  aircraft.  All  but  one  of  tliese  aircraft,  the 
F-5,  experienced  significantly  dc.'lining  programs  throughout 
the  decade  of  the  70s.  At  the  beginning  CY71,  the  Vietnam  War 
was  under  way,  and  both  flying  programs  and  EOQ  usage  were  sig¬ 
nificantly  higher  than  during  tlie  last  half  of  tlie  decade.  In 


aUiliLiuii,  a  number  of  tlie  aircraft  associated  with  INSSIM  Data 
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Bank  items  were  phased  out  of  the  USAF  inventory  during  tliis 
period.  Aircraft  whose  flying  programs  went  to  zero  during 
this  period  include  the  C-118,  C-121,  F-102,  and  T-29.  In  addition, 
the  flying  program  of  the  F-104  dropped  to  zero  during  the  first 
quarter  of  CY-76,  but  increased  significantly  in  the  third  quarter 
of  CY-76  to  support  Foreign  Military  Sales  activity.  As  noted 
earlier,  we  have  found  that  forecast  errors  for  items  associated 
with  F-5  and  F-104  aircraft  are  significantly  higher  than  for 
other  INSSIM  items.  Consequently,  ail  F-5  and  F-104  items  were 
excluded  from  the  item  samples  used  in  this  study. 

Considering  the  general  decline  in  flying  program  activity, 
its  not  surprising  that  the  demand  patterns  of  all  four  item 
samples  used  in  this  study  drop  during  the  30  quarter  simu¬ 
lation.  For  example,  Figures  ll-l  thru  II-4  present  the  dollar 
value  of  demands  observed  for  the  OC.H,  SM.H,  OC.L,  and  SM. L 
samples  during  the  CY73-79  interval.  As  shown  in  Figure  11-1, 
the  dollar  value  of  demands  for  OC.H  items  dropped  s i gn i f i can  i  1  y 
during  the  CY73-75  interval,  but  remained  fairly  stable  for  t  hi. 
remainder  of  the  CY73-79  interval.  On  the  other  hand,  the  dollar 
value  of  demands  associated  with  the  SM.H  sample  presented  in 
the  Figure  II-3  show  a  significant  and  continuing  decline  tiirough- 
out  the  Cy73-79  interval.  For  the  low  activity  samples  OC.L 
and  SM.L,  the  dollar  value  of  demand  is  more  stable,  but  is 
slightly  lower  during  the  later  portion  of  the  CY73-79  interval 
than  during  the  first  eight  quarters  of  tliis  period. 


Do] 


gure  11-3.  Dollar  Denand  per  Quart 
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Monte  Carlo  Generation  of  Rcqui s i t i on  Si zos 

In  the  Inventory  System  Simulator,  the  number  of  units  gener¬ 
ated  in  a  given  quarter  exactly  equals  the  historical  demand 
values  recorded  in  the  INSSIM  Data  Bank  for  that  particular  item. 
However,  Monte  Carlo  techniques  must  be  used  to  generate  the 
specific  requisition  sizes  and  to  determine  the  precise  time 
of  requisition  arrival  within  a  given  quarter.  In  this  study, 
we  assumed  that  requisition  sizes  were  described  by  a  negative 
binomial  distribution,  and  the  parameters  of  this  di st r i bur i on 
were  estimated  from  the  12  most  recent  demand  values  associated 
with  a  given  item  in  the  INSSIM  Data  Bank.  Figures  in  II-5  t'nru 
II-8  present  plots  of  the  total  number  of  requisitions  generated 
each  quarter  for  samples  OC.H,  SM.H,  OC.L,  and  S'l.l.,  respectively. 
As  may  be  seen  from  the  figures,  these  aggregate  requisition 
counts  roughtly  parallel  the  total  doll.ar  dcmaiuls  pi  eseniedi  .  n 
Figures  II-l  thru  II-4. 

On  Hand  and  Excess  Stocks 

Figures  II-9  and  II-IO  plot  the  behavior  of  on-hand  and  oxcess 
stocks  observed  in  simulating  Run  Code  1030  for  item  sample  OC.H. 
Using  the  coding  scheme  defined  in  Tables  I-l  and  1-2  of  Section  I, 
this  Run  Code  represents  Policy  Code  10  (the  current  D062  inventory 
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Figure  11-7.  Requl  si  tionr.  per  Quarter  for  Sample  OC 
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management  formulas),  with  a  Supp(,rt  Code  of  30,  cor  rcspondi  ni, 
to  an  implied  shortage  cost  of  $500.  Figure  II-9  plots  tlie  simu¬ 
lated  behavior  of  on-hand  and  on-order  stocks,  and  backorders 
throughout  the  CY  73-79  simulation.  As  noted  earlier,  in  the 
simulation  initial  on-hand  stocks  are  set  equal  Co  the  expected 
demand  in  a  lead  time,  and  all  on-order  stocks  are  set  equal 
to  zero.  Consequently,  all  items  with  a  positive  safety  level 
generate  new  buys  during  the  first  period  of  the  simulation. 

Also,  no  item  is  ia  a  backorder  or  excess  position  at  sinulited 
time  zero.  As  shown  in  Figure-9,  this  results  in  an  initiii 
surge  of  ordering  activity  followed  by  a  growth  in  on-'iar.  i  stocks 
as  these  initial  orders  are  delivered.  The  ordering  pactern 
declines  in  the  later  portion  of  the  simulation  due  to  cho  iccreas- 
ing  demand  activity  of  a  majority  of  sample  items. 

Figure  II-IO  presents  a  plot  of  the  combined  stock!  t',.',  uijjcc- 
tive  (denoted  by  "0")  observed  during  t  lu;  30  quarCer  siMulaLtoa 
interval  for  all  items  included  in  the  OC.Ii  sample.  This  curve 
represents  the  sum  of  the  Air  Force  Acquisition  Objectives  (Ai'AO) 
for  all  items  at  a  given  point  in  time.  By  definition,  the  AFAU 
equals  the  sum  of  the  reorder  level  requirement  and  the  EOQ. 

If  demand  forecasts  were  perfect,  the  AFAO  is  the  maximum  amount 
of  stock  that  should  be  on-hand  and  on-order  at  a  given  point 
in  time.  Thus,  the  AFAO  curve  represents  an  upper  limit  to  the 
amount  of  stock  desired  in  the  on-hand/on-order  pipeline.  As 
shown  in  Figure  II-IO,  the  desired  stocking  objective  decreased 
as  the  simulated  time  progressed. 
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Figure  II-IO  also  plots  three  iieasurcs  of  the  vimouat  of  excess 
stock.  In  the  figure,  the  "E"  denotes  the  dollar  value  of  stock 
which  is  in  excess  of  the  AFAO.  Similarly,  the  plot  symbol  "2" 
denotes  the  dollar  value  of  stock  which  is  more  than  two  years 
of  supply  in  excess  of  the  AFAO,  while  the  symbol  "5"  denotes 
the  dollar  value  of  stocks  which  exceed  the  AFAO  plus  five  years 
of  supply. 

Note  that  the  total  AFAO  drops  throughout  the  30  quarter 
interval,  while  all  three  measures  of  excess  stock  grow  continuously. 

The  general  patterns  of  on-hand  and  excess  stock  behavior 
in  Figure  II-9  and  11-10  are  also  observed  for  otlier  inventory 
management  policies.  For  example.  Figures  TI-ll  uni  11-12  nro'.ent 
similar  plots  of  on-hand  and  excess  stock  using  Run  Code  801 s. 

This  Run  Code  corresponds  to  the  use  of  Policy  Code  80  (the  expo¬ 
nential  error  model  using  a  Fixed  leadtime  assumption)  and  a 
shortage  cost  factor  of  $100.  This  shortage  cost  was  selected 
because  Run  Code  8015  spends  an  amount  of  money  approxiir.a  to  Ly 
the  same  as  that  spent  by  Run  Code  1030.  As  shown  in  Figure 
II-ll,  approximately  the  same  general  pattern  of  on-hand  and 
on-order  stock  activity  as  was  observed  for  Run  Code  1030  is 
associated  with  Run  Code  8015.  Also,  Figure  11-12  shows  Run 
Code  8015  produces  approximately  the  same  general  pattern  of 
excess  stocks  as  was  observed  for  Run  Code  1030. 


Figures  11-13  thru  11-10  present  similar  plots  of  on-hand 
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and  excess  stock  for  sample  SM.H  using  Run  Codes  1030  and  8015, 
respectively.  Note  that  in  this  case,  too,  we  observe  an  initially 
high  level  of  ordering  activity  followed  by  a  growth  in  on-hand 
stocks.  In  addition,  these  runs  also  show  a  continuously  increas¬ 
ing  growth  in  excess  stocks  as  the  time  interval  progresses. 

Recall  that  in  Figure  1 1 -2,  wc  observed  that  sample  SM.H  experi¬ 
ences  a  significantly  declining  demand  pattern  throughout  the 
simulation  period.  As  shown  in  Figure  11-14,  this  is  reflected 
in  a  significant  drop  in  the  desired  stocking  objectives  during 
the  CY73-79  interval,  and  a  significant  increase  in  excess  inven¬ 
tory. 

Plots  of  on-hand  and  excels  stocks  for  samples  SM.L  and  OC.L 
are  presented  in  Figures  11-17  thru  11-24.  Note  that  for  these 
low  demand  samples,  the  initial  order  quantities  are  very  high 
relative  to  the  average  ordering  rates  observed  in  later  periods. 
These  large  initial  buys  result  in  a  significant  increase  in 
on-hand  stocks  over  the  levels  at  which  the  simulation  was  initial¬ 
ized.  However,  note  that  on-hand  stocks  tend  to  increase  through¬ 
out  the  simulation  for  botli  low  activity  samples.  Also,  note 
that  excess  stocks  grow  at  a  faster  proportionate  rate  for  these 
low  activity  items  than  was  observed  for  the  high  activity  item 
samples.  Further,  observe  that  these  general  observations  apply 
to  both  the  Policy  Code  10  and  Policy  Code  80  runs. 

We  have  discussed  plots  of  only  two  of  the  policies  whicli 
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were  investigated  in  this  study.  However,  similar  general  obser¬ 
vations  may  be  found  if  we  look  at  detailed  plots  for  these  other 
item  samples.  The  general  patterns  of  behavior  appear  to  be 
dominated  by  the  demand  patterns  for  the  individual  items,  and 
similar  patterns  of  on -hand  and  excess  stocks  are  generated  under 
all  item  policies.  However,  ditfercnces  among  the  item  samples 
do  exist.  These  differences  will  be  discussed  in  more  detail 
in  Sections  III  and  IV. 
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Section  III 


INSSIM  Sensitivity  Mcii  siircmcn  t  s 

The  Inventory  System  Simulator  (INSSIM)  is  driven  by  actual  Air 
Force  demand  histories.  The  simulation  is  constructed  such  that 
the  demand  per  quarter  for  a  simulated  item  exactly  equals  tic 
historical  values  recorded  for  that  item  in  D062  history  tapes. 
However,  Monte  Carlo  techniques  must  be  used  to  determine  ; he 
priority  and  size  of  each  individual  requisition  that  is  .si;;.u- 
lated  within  a  quarter,  and  to  determine  the  precise  rime  of 
arrival  of  each  requisition  within  a  quarter.  In  this  section, 
we  report  results  of  a  series  of  runs  to  evaluate  the  impact 
of  the  variability  introduced  by  these  Monte  Carlo  techniques 
upon  overall  system  performance.  We  also  report  results  of  a 
pilot  study  to  evaluate  the  effectiveness  of  a  Inventory  Policy 
Code  20  which  deletes  "outliers",  i.e.,  Policy  Code  20  (h'letes 
items  which  are  abnormally  large  relative  to  other  observed  demand 
values . 

The  Simulation  Scenario 

All  simulation  runs  reported  in  this  section  used  the  current 
D062  inventory  management  formul.is  f  Pol  icy  Code  10)  for  fore¬ 
casting  and  control  level  calculations.  That  is,  the  PT- formulas 
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WLTc-  uscJ  to  compute  order  quanities  and  safety  stocks  for  all 
items,  and  the  computed  EOQ  and  safety  level  values  were  then 
bounded  using  the  same  rules  as  employed  in  the  current  DOCZ 
system.  A  detailed  description  of  these  rules  was  presented 
in  Section  I.  With  the  exception  of  Policy  20,  all  runs  use 
the  same  forecasting  and  estimation  equations.  Policy  how¬ 

ever,  deletes  outliers  from  the  moving  average  estimates  of 
quarterly  demand  rates.  What  differed  among  the  runs  reported 
in  this  section  was  the  combination  of  factors  for  whicl'.  '‘‘ci'te 
Carlo  techniques  were  used. 

Table  III-l  presents  the  parameters  utilized  for  runs  reported 
in  this  section,  as  well  as  the  Policy  Codes  assigned  to  si;:',piify 
our  discussion  of  these  formulas.  Policy  Code  10  represents 
our  baseline  case.  For  this  Policy  Code,  resupply  lead  tines 
were  treated  as  gamma  distributed  random  variables,  with  a  coeffi¬ 
cient  of  variation  of  .5i)3,  and  high  priority  renuisitions  were 
generated  with  a  SO-i  cliancc.  On  the  other  luuul ,  Policy  Codes 
11  and  12  both  treat  resupply  lead  time  as  a  cunslani.  lu  I’ulicy 
Code  11  runs,  all  requisitions  were  treated  as  high  priority, 
and  consequently  an  attempt  was  made  to  immediately  fill  each 
simulated  requisition  as  long  as  tlierc  was  stock  on  hand.  On 
the  other  hand.  Policy  Code  12  runs  generated  both  high  and  low 
priority  requisitions.  Tn  this  case,  there  was  a  50/50 
chance  that  the  requisition  was  high  priority.  In  this  case, 
if  a  low  priority  requisition  arrives  when  on  hand  stock  is  Ics 
than  a  1  month  supply,  the  requisition  is  back  ordered  until 
additional  stock  becomes  available.  Policy  Code  13  simulated 


Table  lll-l 

Parameters  for  Lead  Time  and  Priority 
Sensitivity  Analysis  Runs 


Policy 

Code 

Shortage 

Cost 

Factor 

Percent 

High  priority 
Requisitions 

Resupply 

Lead  Time 

Management 

Formulas 

10 

500 

50% 

Random 

Current 

11 

500 

100% 

Constant 

Current 

12 

500 

50% 

Constant 

Current 

13 

500 

100% 

Random 

Current 

20 

500 

50% 

Random 

Current, 

'vitli  outliers 
excluded 
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the  situation  in  which  resupply  lead  time  was  pamma  ci  i  st ;  i  l)ut  ed , 
and  all  requisitions  were  high  priority.  Finally,  as  discussed 
above,  Policy  Code  20  runs  were  identical  to  Policy  Code  10  runs 
with  the  exception  that  outliers  were  excluded  from  demand  rate 
calculations.  Precise  rules  used  in  Policy  Code  20  calculations 
are  discussed  in  Section  I. 

We  performed  twelve  simulation  runs  using  Policy  Cotlc  1C 
for  each  of  the  four  item  samples.  In  six  of  these  tuclce  luns, 
the  requisition  generation  process  was  controlled  so  trsat  evactly 
the  same  stream  of  requi s i t ions- - wi th  each  requisition  arriving 
at  the  same  simulated  instant  and  involving  the  same  niim-'or  of 
units--was  used  in  each  simulation  run.  These  six  rtinr  um.  d: 
implied  shortage  cost  factors  of  .1,250,  500,  750,  lOOC,  nr' 

2000,  respectively.  Hence,  these  six  runs  illustrate  how  rolicy 
code  10  would  have  performed  under  differing  fnrding  levels  (baling 
with  exactly  the  same  requisition  stream.  IVe  also  used  tiio  same 
sequence  of  support  level  values  for  six  additional  Polic>  Code 
10  runs  for  each  item  sample.  In  this  second  sequence  of  six 
runs,  the  size  and  timing  of  requisitions  within  a  given  quarter 
was  allowed  to  vary  from  run  to  run.  However,  as  in  all  IXSSIM 
runs,  for  a  given  item  exactly  the  same  total  number  of  units, 
with  the  same  total  dollar  value,  was  simulated  each  quarter 
in  each  of  these  runs.  Thus,  a  comparison  of  the  results  of 
the  two  sequencies  of  twelve  runs  gives  an  indication  of  the 
impact  of  variability  of  requisition  sizes  and  of  timing  within 
a  given  quarter  upon  the  variability  of  simulation  results. 
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Policy  Codes  11,  IJ,  13,  and  .0  were  each  ran  under  two  diffe¬ 
rent  requisition  streams.  In  one  of  these  runs,  which  wc  denote 
by  a  we  used  exactly  the  same  sequence  of  requisition  as 

described  for  Policy  Code  10  above.  In  the  second  of  these  runs, 
the  size  and  timing  of  individual  requisitions  within  a  quarter 
was  allowed  to  vary.  We  use  a  "+”  to  denote  runs  in  the  second 
catagory.  In  all  of  these  runs  for  poliev  codes  11,  12,  1.-, 

and  20,  we  used  an  implied  shortage  cost  of  $500.00. 

Figures  III-l  thru  II1-8  illustrate  our  results.  rign-c.s 
III-l  thru  TII-4  plot  the  observed  average  requisition  wet!  s 
delay  verses  the  corresponding  total  simulated  30-quarter  prccure- 
ment  expenditures.  The  curves  are  for  samples  OC.P,  S'  .l’,  nc.I  , 
and  SM.L  respectively.  On  the  other  liand,  figures  T I  1  -  5  tiM'u 
ITI-8  plot  requisition  fill  rate  verses  Buy  Dollar  curves  f jr 
each  of  these  samples.  As  noted  above,  points  marked  h;- 
represent  simulation  runs  wliich  had  exactly  tlie  same  requisi¬ 
tion  stream  as  all  other  runs.  On  the  other  I'and,  points 

marked  by  a  "  +  "  may  represent  a  different  reqiiisitinn  stieam 
from  run  to  run.  Again,  bowevei',  exactly  tlie  same  number  of 
units  per  quarter  were  simulated  for  each  sampled  item  in  every 
run  in  which  that  item  was  involved. 

In  Figure  III-l,  the  lines  connect  points  rcprcs<int  i  nj’,  tin 
observed  average  requisition  weeks  of  delay  and  corresponding 
Buy  Dollars  using  Policy  Code  10  under  several  different  fundin;’ 
levels.  Tliese  provide  a  frame  work  of  comparison  with 
the  individual  points  representing  Policy  Code  11,  12,  13,  and 
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20  results.  Note  that  the  hotli  and  "  +  "  for  Policy  Code  20 

points  are  significantly  above  and  to  the  right  of  these  baseline 
curves.  This  indicates  that  these  Policy  Code  20  results  are 
significantly  less  cost  effective  than  values  which  were  achieved 
using  Policy  Code  10.  Note  that  the  curve  for  Policy  Code  10 
also  dominated  the  points  for  Policy  Codes  li  and  12,  but  that 
Policy  Code  13  fell  below  the  Policy  Code  10  cost  effectiveness 
curve . 

Figure  III-2  presents  similar  requisition  delay  versus  Buy 
Dollar  results  for  the  sample  SM.H.  In  this  sample,  average 
requisition  weeks  of  delay  was  a  more  erratic  statistic  and  tl.e 
curves  jump  around  significantly.  For  this  data,  set,  policy 
code  20  also  performs  very  badly  relatively  to  tlie  Policy  Code 
10  curve.  On  the  other  hand,  it  is  difficult  to  d  i  st  i  n  gu  i -s  b 
between  Policy  Code  10  results  and  the  results  for  Policy  Codes 
11,  12,  and  13. 

The  results  for  samples  in  OC.I,  and  SM.L  are  presented  in 
Figures  TII-3  and  III-4.  In  these  figures  Policy  Code  20  also 
performs  quite  badly,  and  the  results  for  Policy  Code  11  and 
12  are  also  dominated  by  the  Policy  Code  10  results. 

Figures  III-5  thru  111-8  present  the  observed  requisition 
fill  rate  verses  Buy  Dollar  cuves  for  each  of  the  four  item  samples 
In  this  case,  an  ideal  point  would  lie  to  the  left  and  above 
other  points  on  the  graph,  i.e.,  an  ideal  policy  would  spend 
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less  money  to  achieve  a  h  iyhor  fill  rate.  As  shown  in  I'igure 
III-5,  policy  code  10  dominates  the  results  for  policy  codes 
11,  12,  and  20,  and  matches  the  results  for  policy  code  13. 

Similar  findings  apply  to  Figures  III-6  thru  III-8.  Note  that 
Policy  Code  20  was  dominated  by  Policy  Code  10  in  all  item  samples. 
As  a  result,  Policy  code  20  was  dropped  from  furtlier  considera¬ 
tion  in  our  search  for  improved  inventory  management  policies. 

Tables  III-2  and  III-3  summarize  the  average  requisition 
delay  and  fill  rate  results  for  policy  codes  10,  11,  12,  and 
13.  All  of  these  runs  used  the  current  D062  safety  level  formulas 
and  an  implied  shortage  cost  of  $500.  Thus  the  inventory  manage¬ 
ment  formulas  would  have  computed  exactly  the  same  order  levels 
and  the  order  quantities  for  a  given  item  under  all  four  of  these 
policies.  Consequently,  any  differencics  in  observed  results 
among  these  runs  are  due  to  the  impact  of  variability  in  citlicr 
the  load  time  or  requisition  generation  procedures. 

A  very  interesting  and  surprising  statistic  emerges  from 
these  tables.  Notice  that  the  simulation  runs  whicli  involve 
a  random  lead  time  have  better  requisition  delav  and  fill  rate 
statistics  then  the  corresponding  runs  in  which  the  lead  time 
was  treated  as  a  constant  !  That  is,  when  the  lead  times  were 
random  we  observed  better  results.  How  can  that  be?  What  could 


have  caused  this  result? 
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We  believe  that  the  explanation  for  the  result  lies  in  iIm 
method  used  to  simulate  lead  times  within  the  simulation.  As 
noted  above,  all  lead  times  were  treated  as  gamma  distributed 
random  variables  with  a  coefficient  of  variation  of  .553.  The 
probability  density  function  f^'r  this  distribution  is  shown  in 
Figure  III-9.  To  represent  this  distribution  within  the  simula¬ 
tion  model,  we  recorded  percentage  points  from  the  cumulative 
distribution  function.  The  selected  points  are  marked  by  the 
dots  in  Figure  III-9.  In  the  simulation  model,  we  used  linear 
interpolation  to  determine  the  specific  lead  time  values  wi  ici: 
were  between  the  tabulated  points.  Although  this  linear  apprr.v,;. 
mation  appears  to  provide  an  excellent  fit  to  the  gamma  distri¬ 
bution,  it  turns  out  that  the  average  lead  time  generated  b'.- 
the  linear  approximation  is  approximately  95“}.  of  the  specif  ;ei; 
mean  value.  That  is,  simulated  lead-times  drawn  from  t  i- i  s  linear 
approximation  to  the  gamma  distribution  average  5?  less  than 
the  desired  expected  lead  time  for  the  gamma.  Hence,  in  all 
simulation  runs  which  involve  random  lead  times,  the  sinuilatcel 
lead  times  averaged  approximately  5i  less  than  in  those  simula¬ 
tion  runs  in  which  tlie  load  time  was  treated  as  a  constant. 

The  shorter  mean  lead  time  should  have  resulted  in  better  supply 
effectiveness,  but  the  variability  in  lead  time  should  produce 
an  opposite  tctulancy.  In  our  luns,  s  i  gn  i  f  i  can  t  1  y  ifnprovoil  effec¬ 
tiveness  was  observed.  This  may  demonstrate  that  supplv  effec¬ 
tiveness  is  extremely  sensitive  to  errors  in  mean  lead  time  esti¬ 
mates.  However,  additional  research  is  needed  to  test  this  conic 
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All  of  the  simulation  runs  reported  in  the  next  section  used 
the  same  linear  approximation  lead  time  generation  process  as 
described  above.  Thus,  each  of  the  runs  would  have  used  simu¬ 
lated  lead  times  that  averaged  about  951  of  the  estimated  lead 
time  values  used  in  the  inventory  control  level  calculation  formulas. 
Fortunately,  since  all  of  the  formulas  were  subject  to  the  same 
lead  time  generation  process,  estimates  of  the  relative  effec¬ 
tiveness  of  the  alternate  inventory  policies  should  not  lie  effected 
by  the  simulated  bias  in  the  estimated  lead  time  values.  In 
the  next  section,  we  discuss  the  relative  performance  of  the 
alternate  formulas. 


Section  IV 


Comparison  of  Alternate  inventory  Management  Policies 


Introduction 


The  objective  of  this  study  is  to  evaluate  the  relative  cost 
effectiveness  of  several  proposed  methods  for  managing  liOQ  inven¬ 
tories  when  lead  times  are  subject  to  significant  variability. 

In  this  section,  we  report  the  results  of  simulation  experiments 
to  evaluate  the  performance  of  the  alternate  policies  discussed 
in  detail  in  Section  I.  For  convenience,  Table  IV- 1  summarizes 
the  major  inventory  management  policies  considered.  As  noted 
in  Sec  ion  III,  our  initial  pilot  tests  indicated  that  Policy 
Code  20  was  inferior  to  Policy  Code  10  techniques,  and  consequently 
Policy  Code  20  was  deleted  from  consideration  in  this  Section. 


Measures  of  Effectiveness 

A  critical  issue  in  every  m-.4nagement  situation  is  to  establish 
appropriate  criteria  for  selecting  among  proposed  alternatives. 
Ideally,  we  would  like  to  select  an  inventory  management  policy 
which  provides  the  most  effective  means  of  accomplishing  Air 
Force  programs.  We  would  particularly  like  to  be  able  to  spend 
procurement  dollars  in  a  manner  that  would  provide  the  maximum 
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Tabic  IV -1 


Inventory  Vlanagetrient  Policy  Codes 


Inventory  Managyinr-tu  Policy 
Current  0062  Formulas 

Current  D062  Formulas,  with  outliers  excluded  from  demand  and  vari 
ance  estimates 


Current  D062  Formulas,  with  adjustments  to  standard  deviation  o! 
lead  time  demand  to  account  for  lead  time  variability 

Scaled  Negative  Binomial  reorder  point  calculations,  with  no  bounds 
on  safety  level 

Constant  Leadtirne  Exponential  Forecast  Error  model,  with  no 
on  safety  level 


Exponential-Gamma  Forecast  Error  Model,  with  no  bounds  on  safety 
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system  effectiveness  for  a  given  level  of  expenditure.  Unfortunately, 
the  linkage  between  aircraft  availability  and  depot  level  inventory 
policies  is  very  complex,  and  analytical  methods  for  quantifing 
these  relationships  are  not  available.  Consequently,  several 
other  depot-level  performance  measures  have  been  utilized  in 
past  studies  as  a  basis  of  comparision  among  alternate  inventory 
management  policies.  Measures  of  effectiveness  which  are  partic¬ 
ularly  relevant  to  this  effort  include: 

Requisition  fill  rate. 

Unit  fill  rate. 

Average  requisition  delay  time. 

Average  unit  delay  time. 

Long  supply  dollars. 

Procurement  expenditures. 

There  is,  of  course,  a  close  relationship  among  all  of  these 
measures.  In  particular,  the  more  money  that  is  expended  for 
safety  stocks,  the  higher  the  level  of  supply  effectiveness  and 
long  supply  that  may  be  expected.  Figure  IV-1  illustrates  a 
hypothetical  fill  rate-Buy  Dollar  curve.  As  shown  in  the  figure, 
as  Buy  dollars  increase,  the  fill  rate  associated  with  the  supply 
system  would  also  be  expected  to  increase. 

Unfortunately,  it  is  computationally  prohibitive  to  evaluate 
each  proposed  policy  for  each  possible  funding  level.  Consequently, 
to  keep  computational  needs  within  reasonable  limits,  we  evaluated 
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each  proposed  inventory  management  policy  for  each  sample  at 
six  different  support  levels.  This  permits  us  to  develop  a  six- 
point  approximation  to  the  underlying  cost  effectiveness  curve 
for  each  formula.  By  connecting  the  resulting  fill  rate  and 
Buy  dollar  points,  we  obtain  an  approximation  to  the  "true"  underly¬ 
ing  cost  effectiveness  relationship.  If  these  points  are  close 
together  on  the  effectiveness  curve,  a  linear  approximation  obtained 
in  this  way  should  provide  a  good  approximation  to  the  true  underly¬ 
ing  curve.  On  the  other  hand,  if  the  resulting  points  are  widely 
spaced,  such  a  linear  approximation  may  provide  a  very  poor  fit 
to  the  underlying  theoretical  curve.  For  example,  if  the  [joints 
A  and  C  in  Figure  IV-1  are  joined,  the  resulting  linear  approxima¬ 
tion  is  a  poor  estimate  for  the  point  B  shown  in  the  figure. 

Figure  IV-2  illustrates  a  hypothetical  curve  relating  expected 
average  delays  versus  procurement  expenditures.  In  this  case, 
the  higher  levels  of  procurement  expenditures  should  result  in 
reduced  requisition  backorders  and  reduced  delays  in  filling 
an  average  requisition.  Low  funding  levels  should  result  in 
relatively  high  average  delays,  while  high  funding  levels  should 
result  in  very  short  delays.  In  simulating  a  specific  policy, 
we  will  of  course  obtain  only  single  points,  such  as  ’■hose  illustrated 
by  "*'*  Figure  IV-2.  In  this  case,  connecting  the  observed  average 
delay  vs  Buy  dollar  points  will  result  in  a  upper  bound  to  the 
underlying  curve. 
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Simulation  Results  for  Sample  SM.  II 


As  discussed  in  Section  I,  we  simulated  each  of  the  proposed 
inventory  management  policies  using  each  of  four  separate  item 
samples.  In  the  following  paragraphs,  we  present  the  detailed 
support  effectiveness  curves  obtained  for  the  sample  SM.H,  i.e. 
for  the  high  activity  sample  selected  from  Sacremento  Air  Logistics 
Center  history  records.  Similar  curves  for  samples  OC.H,  SM.L, 
and  OC.L  are  presented  in  Appendices  A,  B,  and  C,  respectively. 
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Figure  IV-3  presents  requisition  fill  rate  vs  Buy  iluliai 
curves  observed  from  our  30  quarter  simulation  of  sample  SM,!1. 
Recall  that  policies  70  and  90  have  no  lower  bounds  on  safety 
levels.  Consequently,  these  policies  are  able  to  spend  less 
money  than  the  other  inventory  management  policies.  On  the  other 
hand.  Policy  Codes  10,  GO,  and  80  have  a  lower  bound  of  zero 
on  the  safety  stock;  i.e.  the  reorder  lever  for  these  policies 
is  bounded  to  be  at  least  equal  to  the  expected  demands  in  a 
lead  time.  For  very  low  values  of  the  implied  shortage  cost, 
all  of  these  policies  will  compute  negative  safety  levels  as 
being  optimal.  However,  because  of  the  lower  bounds,  the  computed 
safety  level  for  Policies  10,  60,  and  80  will  be  reset  to  zero 
in  this  event.  The  result  is  that  Policies  10,  60,  and  80  all 
have  the  same  reorder  levels  for  very  low  values  of  the  iinjilicd 
shortage  cost.  As  shown  in  Figure  IV-3,  all  of  the  lower  bounded 
policies  spend  at  least  34  million  dollars  over  the  30  quartcr 
simulation.  Note  that  these  policies  result  in  lower  requisition 
fill  rates  for  a  $34  million  expenditure  than  the  fill  rates 
produced  by  Policy  Code  70  or  Policy  Code  90  at  t'lis  spending 
level.  At  higlicr  funding  levels,  it  is  difficult  to  distinguish 
among  the  five  curves  at  this  level  of  plot  resolution.  Conse¬ 
quently,  in  Figure  IV-4,  wc  provide  a  "magnified"  look  of  the 
requisition  fill  rate  vs  Buy  $  curve.  As  shown  in  the  figure, 
all  of  the  proposed  alternative  policies  dominate  Policy  Code 
10,  the  current  D062  policy.  However,  the  alternative  curves 
"cross-over”  for  procurement  dollars  between  34  and  38  million 
dollars  and  it  is  difficult  to  select  a  single  policy  as  the 
optimal  one  in  this  region. 


In  Table  IV-ii,  we  have  summarized  our  rankings  of  the  alter¬ 
nate  inventory  management  policies  under  each  of  the  proposed 
measures  of  effectiveness.  As  we  have  just  observed,  all  four 
of  the  Policy  Codes  60,  70.  80,  and  90  appear  superior  to  Policy 
Code  10  results  with  respect  to  the  requisition  fill  rate  measure. 
Consequently,  in  Table  IV-2,  we  have  assigned  each  of  these  four 
policies  of  equal  rank,  and  all  of  them  are  ranked  as  being  super¬ 
ior  to  Policy  Code  10. 

Let  us  now  consider  our  results  for  unit  fill  rates.  Figures 
IV-5  and  IV-6  plot  unit  fill  rate  vs  buy  dollar  curves  observed 
in  simulating  sample  SM.H.  Note  that  it  is  difficult  to  distin¬ 
guish  among  the  curves  when  wc  use  the  scaling  presented  in  Figure 
IV-5.  Consequently,  let  us  consider  the  ’’close-up”  plot  presented 
in  Figure  IV-6.  As  shown  in  the  figure.  Policy  Code  10  is  domi¬ 
nated  by  the  other  four  proposed  alternatives.  In  this  figure. 
Policy  Code  90  dominates  the  results  for  all  other  policies. 

That  is,  Policy  Code  90  produces  a  higher  fill  rate  at  a  given 
level  of  buy  dollars  than  all  of  the  other  policies.  Conversely, 
a  given  fill  rate  may  be  achieved  at  a  lower  funding  level  using 
Policy  Code  90  than  is  pf^ssible  using  any  of  the  other  proposed 
methods.  Note  that  Policy  Code  70  does  very  well  at  extremely 
low  funding  levels.  However,  Policy  70  is  dominated  by  Policy 
Code  80  for  funding  levels  in  the  $36  million  or  more  range. 
Further,  observe  that  the  Policy  Code  60  produces  results  superior 
to  Policy  Code  10  under  all  funding  levels,  but  that  Policy  Code 
60  is  dominated  by  the  other  three  proposed  inventory  management 
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methods.  In  Table  IV- 2,  we  have  summarized  these  results  by 
ranking  the  proposed  inventory  management  policies  as  90,  80, 

70,  60,  and  10,  in  descending  order  of  preference  with  respect 
to  unit  fill  rate  criterion. 

Figures  IV-7  and  IV-8  plot  the  observed  average  unit  delay 
vs  buy  dollar  curves  for  sample  SM.H.  As  shown  in  Figure  IV- 
8,  Policy  Code  90  clearly  dominates  the  other  methods  for  procure¬ 
ment  expenditures  of  34  million  dollars  or  more,  while  Policy 
Code  80  appears  to  be  the  second  best  policy.  The  other  three 
cost  effectiveness  curves  cross.  However,  we  believe  that  three 
remaining  curves  should  be  ranked  in  the  order  of  70,  60,  10, 
in  descending  order  of  preference.  In  particular,  note  that 
Policy  Code  10  is  dominated  by  Policy  Codes  90,  80,  and  70  at 
all  funding  levels. 

Figures  IV-9  and  IV- 10  plot  average  requisition  delay  vs 
buy  dollar  results  for  sample  SM.H.  For  extremely  low  funding 
levels.  Policy  Codes  90  and  70  produce  average  requisition  delays 
as  good  as  those  produced  by  the  lower  bounded  policies,  but 
Policies  90  and  70  required  from  2  to  4  million  dollars  less 
to  achieve  these  results.  On  the  other  hand,  for  procurement 
expenditures  of  $35  million  or  more,  all  of  the  curves  cross, 
and  it  is  very  difficult  to  distinguish  a  dominant  policy.  As 
a  result,  we  have  ranked  all  of  these  policies  as  being  equal 
with  respect  to  the  average  requisition  delay  criterion. 

Figures  IV-11  and  IV-12  plot  long  supply  statistics  verses 
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buy  dollars.  We  use  the  terra  "five  year  long  supply"  to  repre¬ 
sent  the  dollar  value  of  stock  which  is  more  than  five  years 
of  supply  in  excess  of  the  Air  Force  Acquisition  Objective  at 
the  end  of  the  simulation.  As  shown  in  these  figures,  for  a 
given  procurement  dollar  expenditure.  Policy  Code  70  results 
in  the  low  levels  of  long  supply  at  the  end  of  the  30  quarter 
interval.  Policy  Codes  10  and  60  provide  almost  identical  results. 
Finally,  Policy  Codes  80  and  90  provide  the  highest  levels  of 
five-year  long  supply  associated  with  a  given  procurement  expendi¬ 
ture  level. 

Simulation  Results  for  Samples  OC.H,  SM.L,  and  OC.L 

The  detailed  fill  rate  and  average  delay  curves  obtained 
from  simulations  of  samples  OC.H,  SM.L,  and  OC.L  are  presented 
in  Appendices  A,  B,  and  C,  respectively.  Our  evaluation  of  the 
relative  dominance  of  each  of  these  policies  with  respect  to 
each  measure  of  effectiveness  is  presented  in  Table  IV-2.  On 
the  right  hand  side  of  Table  IV-2  we  present  a  combined  ranking 
of  the  alternate  policies.  This  combined  ranking  is  based  on  the 
arithmetic  average  of  the  ranks  associated  with  each  policy  for 
each  of  the  item  samples. 

Let  us  now  consider  Table  IV-2  in  more  detail.  As  shown 
in  the  table,  all  five  policies  were  ranked  as  equal  with  respect 
to  requisition  fill  rate  for  the  high  activity  samples  SM.H  and 
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OC.H.  On  the  other  hand,  for  the  low  activity  samples  SM.L  and 
OC.L,  Policy  90  clearly  produced  superior  requisition  fill  rate 
statistics.  Similarly,  Policy  Code  80  was  ranked  either  second 
or  tied  for  second  in  both  of  these  low  activity  samples  while 
Policy  Code  10  was  dominated  by  all  four  alternatives  in  both 
of  these  low  activity  runs.  The  arithmetic  average  of  the  ranks 
given  above  results  in  a  combined  ranking  of  90,  80,  70,  60, 
and  10,  in  decreasing  order  of  preference  for  these  alternative 
policies. 

Let  us  now  consider  the  rankings  for  the  unit  fill  rate  crite¬ 
rion.  As  shown  in  Table  IV-2,  Policy  Codes  90  and  80  were  the 
first  and  second  best  policies  in  all  four  of  these  item  samples, 
while  Policy  Code  10  was  ranked  last  in  each  case.  The  combined 
ranks  resulted  in  the  relative  order  of  preference  for  the  four 
policies  of  90,  80,  70,  60,  and  10. 

In  the  average  unit  delay  versus  buy  dollars  curves.  Policy 
Code  90  again  dominates  the  other  four  alternatives,  while  Policy 
Code  10  produces  the  worst  results.  In  this  case,  several  of 
the  other  curves  cross  for  specific  samples,  and  consequently 
these  curves  were  ranked  as  equal  in  those  samples.  However, 
when  average  ranks  are  computed,  we  would  again  obtain  the  90, 

80,  70,  60,  and  10  sequence. 

We  obtained  very  mixed  results  for  the  average  requisition 
delay  statistic.  As  shown  in  Table  IV-2,  we  could  not  distin¬ 
guish  a  dominant  policy  for  this  measure  for  sample  SM.H.  For 
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sample  OC.H,  Policy  Codes  60  and  70  appear  to  dominate,  while 
Policy  Codes  90,  80  and  10  were  ranked  as  about  equal  but  inferior 
to  Policy  Codes  60  and  70.  For  the  low  activity  samples.  Policy 
Codes  90,  80,  and  70  appear  to  produce  the  best  results,  while 
Policy  Code  10  was  ranked  last.  When  average  ranks  are  computed. 
Policy  Code  70  has  the  highest  average  rank  and  Policy  Code  10 
has  the  lowest  rank.  However,  the  average  ranks  of  Policy  Codes 
70,  80,  and  90  are  all  very  close  to  one  another  and  they  are 
all  significantly  better  than  the  average  rank  for  Policy 
Code  10. 


Finally,  let  us  consider  the  plots  of  long  supply  vs  procure¬ 
ment  dollars.  In  this  case,  we  again  obtained  mixed  results. 
However,  Policy  Codes  70  and  60  are  rated  better  than  the  other 
alternatives,  while  Policy  Code  80  tends  to  be  ranked  last. 

When  average  ranks  are  computed  for  the  four  samples.  Policy 
Code  60  has  the  best  average  rank,  while  Policy  Code  80  has  the 
worst  average  rank.  The  other  three  policies  have  the  same  aver¬ 
age  rank  in  this  case. 

Summary  of  Cost  Effectiveness  Comparisons 

Which  policy  is  best  depends  upon  what  criteria  is  used  as 
a  basis  of  judgement.  We  have  observed  that  Policy  Codes  90 
and  80  produce  consistently  higher  results  for  requisition  fill 
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rates,  unit  fill  rates  and  average  unit  delays,  while  Policy 
Code  10  is  consistently  worse  than  all  the  other  alternatives 
with  respect  to  these  three  measures.  For  average  requisition 
delays,  we  observed  mixed  results.  Policy  Codes  60,  70,  80  and 
90  were  each  ranked  first  or  were  tied  with  first  in  at  least 
one  of  the  four  item  samples,  and  all  four  of  these  policies 
appear  to  produce  very  similar  results.  However,  Policy  Code 
10  was  always  ranked  last  with  respect  to  the  average  requisition 
delay  criteria. 

Finally,  if  one  considers  the  long  supply  statistics,  we 
come  up  with  an  ordering  of  policies  completely  different  from 
those  observed  in  the  above  paragraph.  The  results  in  all  four 
item  samples  were  mixed.  However,  Policy  Code  80  was  ranked 
last  in  all  four  item  samples  while  several  of  the  proposed  alter¬ 
natives  were  ranked  first  with  respect  with  the  long  supply 
statistic. 


SECTION  V 
Summary  of  Results 

This  paper  presents  the  results  of  simulation  experiments  to 
evaluate  the  relative  effectiveness  of  six  alternative  rules 
for  managing  Air  Force  EOQ  inventories  when  procurement  leadtimes 
are  random  variables.  Detailed  descriptions  of  these  rules  are 
presented  in  Section  I.  The  Inventory  System  Simulator  (INSSIM) 
was  used  to  evaluate  each  of  the  proposed  rules  under  several 
different  funding  levels.  INSSIM  provides  a  detailed  description 
of  the  D062  Economic  Order  Quantity  Buy  Computation  System  and 
uses  actual  Air  Force  demand  histories  to  drive  the  simulation 
process.  For  the  study,  four  item  samples  of  up  to  500  items 
each  were  selected  from  the  INSSIM  Data  Bank. 

The  samples  SM.H  and  SM.L  were  selected  from  Sacramento  Air  Logis¬ 
tics  Center  records,  while  samples  OC.H  and  OC.L  were  selected 
from  Oklahoma  City  ALC  records.  The  high  activity  samples  SM.H 
and  OC.H  consisted  of  items  which  had  net  demands  in  CY71-72 
which  exceeded  $5000  per  year,  while  the  samples  SM.L  and  OC.L 
consist  of  items  with  net  CY71-72  demands  which  were  less  than 
$5000  per  year. 

Thirty-eight  quarters  of  history  covering  the  CY71-79  interval 
were  available  for  each  of  these  items.  The  first  eight  quarters 
of  data  were  used  to  initialize  the  forecasting  and  inventory 
management  rules,  while  the  remaining  30  quarters  of  data  were 
used  to  simulate  the  behavior  of  each  of  these  rules.  Thus, 
the  simulation  results  evaluate  how  each  of  these  rules  would 
have  performed  had  they  been  employed  during  the  CY73-79  interval. 


Section  II  describes  the  aggregate  behavior  of  each  of  the  item 
samples,  while  Section  III  presents  measurements  of  the  vari¬ 
ability  that  is  induced  into  the  simulation  results  by  the  use 
of  Monte  Carlo  techniques.  In  this  section,  we  found  that  Policy 
20  was  inferior  to  the  current  D062  rules  (Policy  Code  10),  and 
consequently  Policy  20  was  dropped  from  further  consideration. 
Finally,  Section  IV  presents  supply  effectiveness  curves  which 
quantify  the  relative  performance  of  each  of  the  remaining  inven¬ 
tory  management  rules. 

Table  IV-2  summarizes  our  rankings  of  the  relative  performance 
of  each  of  the  proposed  rules  for  each  item  sample  and  also  pre¬ 
sents  a  combined  ranking  based  upon  the  arithmetic  average  of 
the  individual  sample  ranks.  We  found  that  Policy  Codes  90, 

80,  and  70  consistently  outperform  Policy  Codes  60  and  10  for 
the  requisition  fill  rate,  unit  fill  rate,  average  and  unit 
delay,  and  average  requisition  delay  measures.  Policy  codes  90 
and  80  performed  particularly  well  for  the  low  activity  samples 
and  for  the  unit-based  measures  of  effectiveness.  On  the  other 
hand,  it  was  difficult  to  distinguish  a  superior  policy  for  the 
requisition-based  measures  for  the  high  activity  samples. 

When  the  long  supply  versus  buy  dollar  curves  were  considered, 
we  obtained  mixed  results.  Policy  Codes  90,  70,  60,  and  10  were 
each  ranked  first  or  tied  for  first  in  at  least  one  item  sample, 
but  Policy  Code  80  was  ranked  last  in  all  cases.  This  is  a  very 
interesting  result,  since  Policy  code  80  performed  very  well 
with  respect  to  each  of  the  fill  rate  and  average  delay  statis¬ 
tics  reported  above.  Apparently,  Policy  Code  80  achieves  its 


improved  supply-ef tectiveness  versus  buy  dollar  performance  by 
taking  higher  risks  that  some  of  its  safety  stocks  will  later 
be  classified  as  excess. 

Implications  for  the  Management  of  Real  World  Inventories 

This  report  presents  quantitative  evaluations  of  alternate  inven¬ 
tory  management  policies  in  a  simulated  D062  environment.  Although 
the  simulation  provides  a  detailed  description  of  the  D062  sys¬ 
tem,  there  are  several  important  differences  between  the  D062 
simulation  model  and  the  actual  D062  environment.  These  differences 
must  be  considered  in  determining  an  appropriate  policy  for  the 
management  of  the  actual  D062  system. 

First,  in  our  simulation  model  the  mean  and  variance  of  procure¬ 
ment  lead  times  were  known  with  certainty,  while  in  practice, 
these  parameters  must  be  estimated  from  available  data.  We  have 
observed  that  several  policies  significantly  outperform  the  cur¬ 
rent  D062  rules  when  accurate  leadtime  data  is  available.  Unfor¬ 
tunately,  the  required  data  is  not  currently  available  in  the 
D062  system,  and  it  appears  that  a  significant  data  processing 
effort  would  be  required  to  routinely  collect  and  update  the 
needed  information.  Thus,  implementation  of  Policies  90,  70, 
or  60  must  either  (a)  await  the  development  of  such  a  system 
or  (b)  use  regression  or  similar  estimates  as  an  interim  measure. 

On  the  other  hand.  Policies  10  (the  current  rate)  and  80  do  not 
require  these  parameters. 

Second,  in  our  simulation  model  we  have  perfect  information  con¬ 
cerning  item  requisition  counts.  In  previous  studies  we  have 
found  that  D062  requisition  counts  are  extremely  unreliable. 
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and  we  believe  that  any  formula  that  uses  D062  requisition  count 
data  is  basing  Air  Force  safety  stocks  on  a  random  number  gener¬ 
ator.  This  problem  appears  particularly  severe  for  the  very 
large  number  of  low  activity  items  managed  by  the  D062  system. 
Hence,  we  believe  the  data  processing  rule  of  garbage  in- -garbage 
out  would  describe  the  results  of  implementing  any  rule  that 
uses  requisition  count  data  in  the  current  D062  system.  Thus, 
rules  70,  60,  and  10  could  be  expected  to  perform  much  worse 
in  the  real  world  system  than  they  have  performed  here  until 
requisition  count  data  accuracy  can  be  improved. 

Observe  that  Policy  Code  80  is  the  only  rule  that  avoids  both 
of  the  severe  data  problems  described  above.  Although  Policy 
Code  90  provided  results  which  were  slightly  superior  to  Policy 
80  effectiveness  curves.  Policy  90  requires  accurate  estimates 
of  lead  time  variability  to  deliver  on  its  promise  of  superior 
performance.  On  the  other  hand.  Policy  80  does  not  require  this 
parameter.  In  addition,  we  believe  that  Policy  80  results  could 
be  further  improved  by  reducing  the  lower  limit  on  safety  stocks. 

Policy  80  has  another  clear  advantage.  Mathematically,  Policy 
80  is  even  simpler  than  the  current  Presutti-Tripp  formulas, 
and  only  a  few  lines  of  computer  code  would  need  to  be  changed 
to  implement  this  rule  in  D062,  in  INSSIM,  in  EOQSIM,  or  in  any 
other  data  system  that  uses  the  current  PT-formulas.  An  illus¬ 
tration  of  the  FORTRAN  code  required  to  implement  Policy  80  is 
presented  in  Decision  Systems  Working  Paper  81-02,  HEDGSIM 


September  1981,  in  Subroutine  LEVELN. 


In  summary,  we  believe  that  significant  improvements  in  inven¬ 
tory  management  effectiveness  may  be  achieved  by  replacing  the 
current  D062  safety  level  rules  (Policy  10)  by  Policy  80  rules 
as  soon  as  possible.  On  the  other  hand,  if  accurate  leadtime 
and  requisition  count  data  were  available,  even  better  results 


should  be  obtained. 
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